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£SJ ■ Abstract 

(— ( | In this paper, the optimal control problem of neutral stochastic functional differential equation 

(NSFDE) is discussed. A class of so-called neutral backward stochastic functional equations of 
Volterra type (VNBSFEs) are introduced as the adjoint equation. The existence and uniqueness 
of VNBSFE is established. The Pontryagin maximum principle is constructed for controlled NSFDE 
with Lagrange type cost functional. 
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£3 ■ 1 Introduction 



In this paper, S > is a constant and T > is the terminal time. Let (f2, JF, F, P) be a complete 
filtered probability space on which a ci-dimensional Brownian motion W — {W(t) : t S [0, T]\ is defined, 
{j^t : t S [0, T]} is the natural filtration of W augmented by all P-null sets in Define J^j := J?o for 
qq ■ any t 6 [—5,0]. Then F := {j^" t : t G [— S, T]} is a filtration satisfying the usual conditions. 

Consider the following stochastic optimal control problem: minimize the Lagrange type cost functional 

cn 



J(u(-)) := E / l(t,X\u(t))dt , 

subject to 

f d [X(t) - g(t, X\ u(t))] = b(t, X\ u(t))dt + a(t, X 1 ,u{t))dW(t), t e [0, T] 



(1-1) 

[x{t) = 4>(t), te [-<5,o], 

where A* denotes the restriction of the path of A on [t — 5,t], and «(•) is the control variable. We will 
establish the maximum principle of this optimal control problem. As we know, it is the first time to 
consider this problem. 

In many applications, people model systems via differential equations, and assume that the evolution 
rate of the state is independent of the past state and determined solely at the present, such as the ordinary 
differential equations and partial differential equations. However, under closer scrutiny, a more realistic 
model would include some of the past state of the system. That is, the evolution rate of state should 
depend not only on the present state, but also some of the past state, or more generally, it should depend 
not only on the past and present state, but also on the evolution rate of the state in the past. In stochastic 
term, it can be expressed by the neutral stochastic functional differential equations (NSFDEs): 

J d[X(t) - g(t, A')] = b(t, A*) dt + <r(t, A*) dW{t), t e [0, T]\ 
\X(t)=cf>(t), t€[-5,0]. 
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If g = 0, it is a stochastic functional differential equation (SFDE). When choosing 8 > T, and git, •), b(t, •) 
and a(t, •) suitably, It contains the interesting case that g(t, •), b(t, •) and <r(i, •) depend on X on [0, t]. 
Neutral functional differential equations model a large class of system with after-effect, which are widely 
used in biology, mechanics, physics, medicine and economics, such as population sizes, commodity supply 
fluctuations and so on. See [T31 [HI 13 HH [HI E] and reference therein. 

By now the research on NSFDEs mostly focuses on the well-posedness and stability of the solutions, 
see [20] [T6l [21] [18l [TO] [19] and reference therein. The optimal control problem of deterministic neutral 
functional differential equation was discussed by [TJ [TTJ [T2] . The maximum principle of controlled SFDE 
was discussed by Hu and Peng 9,5. For the best knowledge of the author, the maximum principle of 
controlled NSFDE is still open. The difficulty of this problem mainly relies on the adjoint equation. As 
we know, adjoint equation is crucial for constructing maximum principle. The solution of NSFDE would 
not be a semi-martingale due to the part git,X*) in the left hand. Therefore, the traditional method 
dealing with the optimal control problem to SDEs introduced by Bismut (2j [3j [4] will not apply. In this 
paper, under a technical condition (A3), we introduce a linear neutral backward stochastic functional 
equation of Volterra type (VNBSFE) as the adjoint equation. The general form of VNBSFE goes as 
following: 



where Y t denotes the restriction of the path of Y on [t, t + 8], Z(-,-) is defined on [0, T + 8] x [0, T + 8], 
and Z(s, t; 8) denotes the restriction of Z on [s, s + 8] x [t, t + 8]. When G = and 8 = 0, it reduces to 



which is discussed by Yong [22] and called backward stochastic Volterra integral equation (BSVIE). 



Similar as Yong [35], the definition of M-solution of VNBSFE ([T2"]) is introduced. Then we prove the 
existence and uniqueness of VNBSFE (jl.2l) and give an estimate. Via the solution of a linear VNSFDE, 
we construct the maximum principle of the optimal control problem of NSFDE (|l.Ij) . When the state 
equation reduces to a stochastic differential equation (SDE) , the maximum principle here will not degen- 
erate to the traditional one in Bismut [4]. We compare this two maximum principles and establish the 
explicit relation between them. 

The rest of this paper is organized as follow: In section 2, we introduce some notations and the optimal 
control problem. Section 3 is devoted to the duality of linear NSFDEs and linear VNBSFEs. In section 
4, the existence and uniqueness of VNBSFE (|1.2[) are proved. In section 5, we construct the maximum 
principle for controlled NSFDE (|2.1j) with Lagrange type cost functional. As an example, when the state 
equation reduces to a SDE, we compare the maximum principle here with the traditional one in [3], and 
establish the explicit relation between them in section 6. 

2 Preliminaries 

In this section, we will introduce some notations and the optimal control problem. 
2.1 Notations 

For any A being a vector or matrix, denote A' as the transformation of A. Denote H as some Euclidean 
space, such as R n ,K nxd , etc., and | ■ | as the norm and (•, •) as the inner product in H. Define 




(1.2) 





h 2 (n;H) := {r, : ft -> H, immeasurable I E[\r)\ 2 } < +00} , 
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For r,s,r,v G [—6,T + 6], define 

^(r,s;H) := \o : [r, s] x Q -> if, F-adapted | £^ |0(u)| 2 du < +oo|, 

^ F 2 ([r, s]; i7) := ^ : [r, s] x ft ->• iJ, F-adapted, path-continuous | E sup |#(u)| 2 < +00 \, 

L 2 (r,s;L 2 (ft;ii)) := {?/> : [r, s] x n -> if, ^([r,s]) x J? T -mcasurablc | £^ |^(M)| 2 rf« < +oo|, 

L 2 (r, s; L 2 (t, v; H)) := ju : [r, s] x [t, 1/] — > if, jointly-measurable | ^ ^ s)| 2 rfs < +oo|, 
L 2 (r, s; Jz? f (t, j/; if)) := |i9 : [r, s] x [t,v] x £1 -> H is ^([r, s] x [r, 1/]) x ^-measurable, 
i9(t, •) is F-adapted for all t G [r,s], \ E J J \d{t,s)\ 2 dsdt < +oo|. 

For simplicity, denote 

Jf 2 (r,s) :=.£f F 2 (r,s;R") x L 2 (r, s; J^ F 2 (r, s; K" xd )), 



equipped with norm 

II(M)IIW, S )= E 

and 



f \9(u)\ 2 du+ f f \${v,u)\ 2 dudv 

J r J r J r 



J( 2 (r, s) := {((9, ■&) G 2 (r, s) 9(t) = E[6(t)] + j 0(r, u)dW(u), Vi G [r, s]} 

2.2 The Optimal Control Problem 

Consider a controlled NSFDE, 

j d [X(t) - g(t, X*)] = b(t, X\ u(t)) dt + a(t, X\ u(t)) dW(t), t e [0, T], 
\x(t) = 4>(t), t G [-6,0], 

where X 1 denote the restriction of X on [t - 6, t], G ([-6, 0]; R"), 

g: [0,T] x ft x C([0, <J];M n ) -> R n , 

& : [0, T] x Q x C([0, <5]; K") x R m -> R", 
a:[0,T]xflx C([0, 5];R n ) x 



(2.1) 



nm . Trunxc 



are jointly measurable, and (/(•, ?/>), £>(•, -0, w) and cr(-, V>, it) are F-progressively measurable for any (tp, u) G 
C([0,6];R n ) x M m . Here, for simplicity, we only discuss the case that g does not depend u. For g depends 
on u, see section 5. 

Let U C R m be a nonempty convex set. Denote 

W ad := {«(•) :[0,T]x!]4 [/, F-progressively measurable | E J \u(t)\ 2 dt < +00 j 

as the admissible control set. For any u(-) G U a d, denote the cost functional as 

J{u{-)) =E\ j l{t 1 X\u{t))dt\, 

where 

l:[0,T]xQx C([0,6];R n ) x R m -> R 



is jointly measurable, and l(-,ip,u) is F-progressively measurable for any (ip,u) G C([0,<5];R") x R m . 
Define l(t, •, •) = 0, for any t G (T,T + 6]. 

Our optimal problem is to find a control u(-) G lA a d, such that 

J(«(-))= inf J(u(.)). 

u(-)6Wad 

Denote X(-) as the solution of NSFDE ()2.1|) corresponding to u(-). Then (X (■) , u(-)) is called the optimal 
pair. 

Here are some assumptions on the coefficients. 

(Af) b, a, l,g are continuously Frechet differentiable with respect to x, and b, a, I are continuously 
differentiable with respect to u. The derivatives b Xl b u cr x , <r u l x ,l u , g x are all bounded. 

(A2) 6(-,0,0),ct(-,0,0),Z(-,0,0) G JSf|(0,T;if), i? = R™, R nxd , R respectively. 5 , 5:E are both contin- 
uous in £, and there is a constant < K < 1, such that ||<7 X || < ft. 

Via the standard argument in [T31 HH] among others, it is not too hard to show that under assumptions 
(Al) and (A2), for any (/>(■) € S^([—S, 0];R") and u(-) G W, NSFDE ^27TJ) admits a unique solution 
A(-) G J^ F 2 ([-<5,T];R"). Thus the cost function J(u(-)) is well-defined. 

3 Adjoint Equation 

Suppose that (X(-),u(-)) is the optimal pair. Let x(') be the solution of the following Linear NSFDE, 
f d[ X (t) - &(t)x*] = |^(t)x* + ^(*Mt)]* + [S !e (t)x* + ^(t)iJ(t)]dH r (t), * G [0,T], 



\x(*)=0, teKO], 



(3.1) 



Denote 



I( X (-))=E l^x'dt 
Jo 

as a linear functional. Here g x (t) ■— gxit^X*), b x (t) := b x (t, X 1 ,u(t)), b u (t) := b u (t, X*, u(t)), a x (t) := 
a x (t,X\u(t)), a u (t) := a u (t, X\ u(t)) and l x {t) := l x (t,X\u{t)). By (Al) and (A2), g x ,b x ,a x ,l x are 
the linear functionals of C([0, 5]; R"). 
Denote 

V ([0,<5];R fex ") := {/ : [0,5] -)• R fex " is bounded variational and left continuous on [0,5)}. 
Via the Riesz Representation theorem, we have the following lemma. 

Lemma 3.1. There exist G(t, ■), B(t, ■) G V ([0,5];W lxn ), E;(i,-) G V o ([0, 5};R dxn )(i = l,-,d) and 
L(t,-) G V ([0,<5];R lxn ) ; sucft tAot/or all G C([0, T];R n ), 

&(t)tf= / G(i,rfr)0(r), = / B(t,dr)0(r), 

Jo Jo 

a x {t)<t> = / V(t,dr)<j>(r), r x (i)0= / L(t,dr)<fi(r). 
Jo Jo 

We need the following technical assumption: 

(A3) There exist probability measures \(i = 0,1,2,3) on [0,5], and G(t,r), B(t,r),%(t,r),L(t,r), 
such that, 

G(t,dr)^>(r) = ( G(t,r)<f>(r)\ (dr), [ B(t,dr)<t>(r) = [ B(f,r)0(r)Ai (dr), 



o 



Z(t,dr)<f>(r)= [ S(t,r)0(r)A 2 (dr), / L(t, dr)cf>(r) = [ L(t,r)<f>(r)\ 3 (dr), 
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Remark 3.1. Assumption (A3) holds in many cases, for example, 

• 9x{t), b x (t), a x (t), L x (t) are all deterministic and continuous in t, (the proof is similar to Lemma 4.1 
in Hu and Peng [9]) 

• In NSFDE (J21J, g(t, X 1 ) = g(t, a(t, r)X(t - r)X {dr)), and 6, a, I possess similar form. 
Under assumption (A3), equation (|3.1I) and the linear functional reduce to 



x (t)- / G(t,r) X (t-r)X (dr) = 



B(s,r)x(s - r)Ai(dr) + b u (s)v(s) 



ds 



(3.2) 



t{s,r) X {s-r)X 2 {dr) + a u {s)v{s) dW{s), 



and 



I(X(-)) = E 



T r S 



JO 



L(t,r) X (t-r)X 3 (dr)dt. 



Denote p(t) :— J Q b u (s) ds + f Q <r u (s) dW(s). We have the following duality. 



Proposition 3.2. Let x G ^([S, T]; K n ) be the solution of NSFDE 
be the adapted M-solution of the following linear VNBSFE: 



and {Y,Z) e ^ 2 (0,T + 5) 



Y(t)-E t / G'(t+r,r)Y(t+r)X a (dr) = / L(t + r, r)X 3 (dr) + / E s / B'(t+r, r)Y(s+r)Xi(dr) 



+ Z'(t + r,r)Z(s + r,t+r)X 2 (dr) 
Jo 

Y(t) = 0, t£{T,T + S}. 
Then the following relation holds: 



ds 



Z(t,s)dW(s), iG[0,T], 



(3.3) 



I( X (-))=E / (p(t),Y(t))dt 



Note that the well-posedness of VNBSFE (|3.3|l will be discussed in the next section. Here we assume 
that ([23]) holds for (Y, Z) 6 ^# 2 (0, T + S). 



Proof. In view of (|3.2p . we have 



t r s 



P(t)=x(t)- / G(t,r) X (t-r)X (dr) 



B(s, r) X (s — r)Xi(dr) ds 



o Jo 



t r s 



E(s,r)x(s-r)X 2 (dr) dW(s). 



JO 



Since Y G JSf F 2 (0, T; R n ), we have 



E 



--E 



(Y(t),p(t))dt 



(Y(t), X (t))dt 



- E 



Y(t), / G(t,r)x(t-r)X (dr)} dt 



t r S 



Y(t), 



B(s, r)x(s — r)Xi(dr)ds) dt 



o Jo 

t r 5 



Y(t), / / E(s,r) X (s-r)X 2 (dr)dW(s))dt 
Jo Jo 



--E 



(Y(t), X (t))dt 



h+h + h 
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By Fubini's theorem, we have 

h = 



and 



/ f T (Y(t), G(t,r) X (t-r))dtX (dr) 
h Jo 

I j (G'(t + r, r)Y(t + r), *(t)) dt X (dr) 

S t-T 

(G'(t + r,r)Y(t + r), X (t))dt\ (dr) 
o Jo 

T I r 8 \ 

G'(t + r,r)Y(t + r)\ (dr),x(t))dt, 



£ £ r)Jj{s)d s , X (t -r)\dt Ai(dr) 

^ y (^B'(t + r,r)J^ Y(s + r)ds, x(t)\ dtX x {dr) 

(it So 5 '( < + r ' r ) y ( s + r ) Al ( dr ) ds ' 



Since (Y, Z) e ^ 2 (0, T + 5), Y(t) = £[Y(t)] + / s) cW(s). Then 



3 =/ W Z(t,s)dVK(s), / / Z(s,r) X (s-r)\ 2 (dr)dW(s) ) dt 
o \Jo Jo Jo I 

Z(t,s), [ t(s,r) X {s-r)\ 2 (dr)\ dsdt 
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r<5 pT 



T,'(t, r)Z(s, t)ds, x(t - r) ) dt X 2 {dr) 



10 Jo \Jt 

r8 r T-r I pT 



E'(t + r,r) J Z(s + r,t + r)ds, x (t) ) dt X 2 (dr) 



T I r T r S 



E'(t + r,r)Z(s + r,t + r)X 2 (dr)ds, x(t) ) dt. 



o \Jt Jo 



(3.4) 



(3.5) 



(3.6) 



Since for any t € (T,T + 8], l{t, •, •) = 0, then L(t, r) = 0, for any t e (T, T + 6}. Deduce from (J3U). 
and (|3.6I) . we have 



(Y(t),p(t))dt 



= E 



= E 



= E 



I [ L(t+r,r)X 3 (dr) - [ Z(t,s)dW(s), x (t)) dt 
o x Jo Jt 1 - 

T , r S 



L{t+r,r)X 3 (dr), X (t))dt 



x JO 
T r S 



L(t,r) X (t-r)X 3 (dr)dt = /(*(•)) 



□ 



4 Well-posedness of VNBSFEs 

In this section, we are concerned with the well-posedness of general VNBSFEs. We introduce the definition 
of adapted M-solution, which was first introduced in Yong [55] for backward stochastic Volterra integral 



equations (BSVIEs). The existence, uniqueness and an estimate of the adapted M-solution of VNBSFE 
are proved. 

Consider a general VNBSFE, 



Y(t) - G(t, Y t ) = *(t) + jf f(t, a, Y s , Z(t, a), Z(s, t; 8))ds + jf Z(t, s)dW(s), t G [0, T]; 
r (*) = £(*), te(T,T + a], 

where V t denotes the restriction of Y on [t, £ + 5], £>(•,•) i s an unknown mapping defined on [0,T + 
<5] x [0, T + 6], Z(t, s) denotes the value of Z at (t, s), and Z(s, i; 5) denotes the restriction of Z(-, ■) on 
[s,s + S\ x [t,t + 8]. 

For any < R < S < T + 6, define 

A[R, S] := {(i, s) G [i?, S] x [i?, 5] i? < t < s < S}, 

A C [R, S] := [R, S] x [R, S] \ A[R, S]. 
For simplicity, denote A := A[0,T], A c := A c [0,T], A s := A[0,T + S] and A^ := A c [0,T + 5]. 

(G, /) in (|4.1I) is called the generator of VNBSFEs. For (G, /), there exist two functional J and F, 

• J : [0,T] X f2 X L 2 (0, (5;R n ) — > 1™ is jointly measurable, and J(-,(f>) is F-progressively measurable 
for any G L 2 (0, <5; R"), 

• F : A x fl x L 2 (0,(5;R n ) x W ixd x L 2 (0, <5; L 2 (0, 5; R nxd )) -> R" is jointly measurable, and 
F(t,-,(f>,w,ip) is F-progressively measurable for all (t,<p,w,ip) fixed in corresponding space, and (J,F) 
satisfies, 

(HI) There are k £ [0,1) and go being a probability measure on [0,6], such that for any <f>, (f> G 
L 2 (0,<5;R"), 



\J(t, <j> t ) - J(t, t )| 2 < k / |0(«) - Ku)\ 2 Qo(du), (4.2) 
Jo 

(H2) There are L > 0, q\ and £2 being probability measures on [0, 6] , such that for all (</>, w, (p), (0, u>, (/?) 
in corresponding space and (t, s) G A 



\F(t, s, 4>, w, ip)) - f(t, s, <j>, w, ip)\ 

< L 



f s I (4-3) 

(u) — 4>\v)\ Qi(du) + \w — w\ + / \ip(u,u) — ip(ll,u)\ Q2(dll) . 

Jo J 

(G, /) are the functionals defined by 

G(t,y t ) = E t [J{t,y t )], f(t,s,y s ,z(t,s),z(s,t;6)) = E s [F(t, s,y s , z(t, s), z(s,t; 6))], 

for all (»(•), «(■)) e ^ 2 (0,T + (5), (*,«) G A. 

(H3) |G(t, 0)| G if F 2 (0, T; R"), / (t, s) := /(*, a, 0, 0, 0, 0) G L 2 (0, T; i? F 2 (0, T; R»)). 

Here is the definition of adapted M-solution of VNBSFE P~Ti 

Definition 4.1. A pair of process (V, Z) G ^ 2 (0,T + <5) is called the adapted M-solution of VNBSFE 
(|4~T]) , if (|4~Tj) holds in Ito's sense for almost all t G [0, T + tf], 

Y(t)=E[Y(t)]+ [ Z{t,s)dW{s), a.e. t G [0,T + 6], 
Jo 

and Z(i, s) = on (t, s) G A s \ A. 
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Remark 4.1. In VNBSFE (|4TTj) . we only set the terminal condition Y(t) = £(t) on (T,T + 5}. The value 
of Y at T is determined via 

Y{T) + G{T,Y T ) = *(T), 
and the value of Z on A£ \ A c is endogenously determined by 

Z(t,s)dW(s), te[T,T + 6]. 



(4.4) 
Jo 

Since / depends on Z{t, s) on A without anticipation, the equality of (|4.1I) is independent of the value of 
Z on As \ A. That is, any value of Z on As \ A equalizes VNBSFE (|4.1j) . For the uniqueness of solution, 
we define Z(t, s) — in Definition 14 . 1 1 on As \ A. 

For all t G [0,T + <S], define a subspace of 2 (0, r), 

^# 2 (0, r) := |(6i,i?) G Jf 2 (0,T) = E[9{t)] + f tf(t, s)dW(s), Vi £ [0, 



equipped with norm 



ll(M)||^ W) = £ 



|(9(w)| 2 cfc- 



|$(s, m)| 2 du (is 



Then ^# 2 (0,r) is a closed subspace of J$? 2 (0,t) under the norm 



' II^ 2 (o,t)- 



In fact, It is also a 



complete space under || • ||„^2( 0)T ), because 
(9,&) G ^# 2 (0,r), viewing 

6{t)=E[e(t)}+ I tf{t,s)dW{s), t<T, 



is equivalent to || ■ ||^2( , r ) m ^ (0,r). For all 



we have 



Then 



E 



f 

.Jo 



\&{t, s)\ 2 ds 



E[\9{t)~E[e{t)]\ 2 ] <mmt 



ikm)i 



JV 2 {0,t) 



= E 



o Jo 



=E 

<2E 

<2E 



\9{t)\ 2 dt^ 
\9(t)\ 2 dt 
\6(t)\ 2 dt 



o Jt 

T pT 



Jt 

T />T 



\9(t)\ 2 dt- 
\-d(t,s)\ 2 dsdt + 
■9(t,s)\ 2 dsdt 
§(t, s)\ 2 ds dt 



■9(t,s)\ 2 dsdt 

t r t 



Jo 



\tf(t,s)\ 2 dsdt 



2||(M)ll^ ( o,r) 
2||(M)||3r» ( o,r) 



Therefore, if (Y, Z) G Jf 2 (0, T + S) is the adapted M-solution of VNBSFE gT]), it means (V, Z) G 
^ 2 (0, T + S) and Z(t, s) = on A s \ A. 

Before showing the existence and uniqueness of adapted M-solution of VNBSFE (|4.1j) . we discuss some 
backward equations. First, consider the following backward stochastic differential equation (BSDE), 



y(t) = C+ / f(s)ds 



z{s)dW{s), t€[0,T], 



(4.5) 



where / : [0, T) x Q 
Then we have 



is F-progressively measurable, and f{t) G Jz? F 2 (0, T; R") and C G L 2 (ft;R"). 



Lemma 4.1. BSDE g3]) admits a unique pair of solution (y, z) G ^ F 2 ([0, T]; E") x «S^ 2 (0, T; W ixd ), and 
for any t € [0,T], 



e^\Y(t)\ 2 + E 



e 0s \Z(s)\ 2 ds 



< E 



2e^|C| 2 + a/ e^\f(s)\ 2 ds 



(4.6) 



where a and /3 are any two positive constants satisfying j3 > — . 



8 



Consider the following backward integral equation, 



p(t,s) = $(*) + J h(t,u)du~J^ u(t,u)dW u , te[0,T], 



(4.7) 



where $ G L 2 (0, T; L 2 (0; 1")), h : [0,T] 2 x ft ->■ R™ are given, and ft G L 2 (0, T; «2f(0, T; R™)). Fixed 
f £ [0, T], equation (14.71) is a BSDE with generator /i(t, •) G ^f F 2 (0, T; R n ) and terminal condition $(i) G 
L 2 (ft;K"). So (@T7]) is a family of BSDEs parameterized by t G [0,T]. Let s = t, y(t) = p(t,t) and 
z(t, u) = u(t, u) when u >t. Then 

y(t) = $(t)+J h(t,u)du- J z(t,u)dW u , t£[0,T]. 



(4.8) 



It is not a BSDE, but a backward stochastic Volterra integral equation (BSVIE), which was first discussed 
in Lin [T7|. 



Remark 4.2. In equation (I4.8[) . the equality is independent of z on A c . Therefore any value of z on A c 
equalizes (|4.8[) . such as z(t,u) = v(t,u) or z(t,u) — 0, (t, u) G A c . Therefore, the uniqueness of equation 
(|4.8[) does not hold. However, in the definition of adapted M-solution, the value of z on A is settled by 
y(t) = E[y{t)\ + j Q z(t, s) dW(s). This determines the uniqueness. 

The following lemma can be found in Yong [22) . 

Lemma 4.2. BSVIE (|4.8p admits a unique pair of solution (y(-), z(-, •)) G ^# 2 (0,T). In addition, 



E 



e* )t \y(t)\ 2 + / e/ s \z(t,s)\ 2 ds 



< E 



<S>(t)\ 2 +a I e Ps \h(t,s)\ 2 ds 



(4.9) 



where a > and f3 > — are any two positive constants. 



The following theorem is devoted to the existence and uniqueness of adapted M-solution and an 
estimation of VNBSFE dill . 

Theorem 4.3. Suppose that (G,f) satisfies (Hl)-(H3). Then for any *(•) G L 2 (0, T; L 2 (f2; R")) and 
£(•) G Jz? F 2 (T, T+S; R"), VNBSFE gT|) admite a urague pair of adapted M-solution (Y, Z) G .^ 2 (0, T+<5). 
Moreover the following estimate holds: 



E 



<CE 



T+S 



\Y(t)\ 2 dt + 



T+S r T+S 



\^(t)\ 2 dt- 



T+S 



\m\ 2 dt 



\Z(t,s)\ 2 dsdt 
\G(t, 0)\ 2 dt 



T i-T 



\f (t,s)\ 2 dsdt 



(4.10) 



Proof. Step 1: Let us define a subset of ^# 2 (0,T + 5): 

^# 2 (0,T) := {(0, 0) G .# 2 (0,T + <5) | 9{t) = Vt G (T,T + <5], and tf(t, s) = 0, V(t,s) eA f \A} 
equipped with the norm 



||(M)I| 2 =£ / e*|0(t)| 2 dt 



T /-T 



e^ s |tf(t,s)| 2 cfe<ft 



where /3 is a positive constant which will be specified in Step 2. It is obvious that ^#^ 2 (0,T) is closed. 
For any (y(-),z(-)) G ^# £ 2 (0,T), consider 



Y(t)-G(t,y t )=V{t)+ [ f(t,s,y s ,z(t,s),z(s,t;S))ds- [ Z(t,s)dW s , te[0,T], 
Jt Jt 

Y(t)=£(t), te(T,T + 5}. 



(4.11) 



!) 



Denote Y(t) := Y(t) - G(t,y t ), then 



Y(t) = *(t) + / f(t, s, y„ z(t, s),z(s, t; 5)) ds 



Z(t,s)dW s , t€[0,T}. 



Since (y,z) G ^|(0,T), f(t,s,y sl z(t,s),z(s,t;S)) G L 2 (0, T; «2f (0, T; R" xm )) via (HI) and (H2). 



(4.12) 



jy(i)-G(t,y(i)), *G[0,T]; 
UW, *e(T,T + <5]. 



Via Lemma H21 (j4.12|) admits a unique pair of solution (Y, Z) G ^ 2 (0,T). Define 

y(t) 

Then V G -S? F 2 (0, T + <5; K"). Define Z(t, s) = on A s \ A and modify the value of Z on A 5 such that 

Y(t) = E[Y(t)}+ [ Z(t,s)ds, Vte[0,T + 6]. 
Jo 

Then (Y, Z) G -# 2 (0,T) is an adapted M-solution of equation (14. lip . 

Step 2: Consider the mapping L : (y(-), z(-, •)) ^> (y(-), •)) with (V, Z) in Step 1. We prove that 
r is a contraction. 

Take another pair {y{-),z{-)) G ^#|(0,T), and denote (Y(-),Z(-)) G ^#|(0,T) as the adapted M- 
solution of (|4~TT|1 with (y(-),z(-)) replaced by (£/(•), £(■))■ Define AY(i) := y(i) - y(i), AZ(t,s) := 
Z(t, s) - Z(t, s), Ay(i) := y{t) - y{t) and Az(i) := z{t, s) - z(t, s). Then 

AY(t)-[G(t,yt)-G(t,y t )} 
f(t,s,y 8 ,z(t,s),z(s,t;S))-f(t,s,y s ,z(t,s),z(s,t;5)) ds + AZ(t, s) dW(s). 



Denote C :— C(L,T,n,d). It varies from time to time. In view of (|4.9[) in Lemma [4.21 and choosing 
(3 = — , we have 



E 



e^\AY(t)-[G(t,y t )-G(t,y t )]f 



e 0s \AZ(t,s)\ 2 ds 



<aE 



<aCE- 



^ s \f(t:S,y s ,z(t,s),z(s,t;5)) - f(t,s,y s ,z(t,s),z(s,t;S))\ 2 ds 



\Ay(s + u)\ 2 g 1 (du) + \Az(t,s)\ 2 + / \Az(s + u, t + u)\ 2 g 2 (du) 



ds 



Integrate P~T3f in t from to T, and denote AG(t) := G(t, y t ) - G(t, y t ), 



E 

<aCE 



e pt \AY(t)- AG{t)\ z dt 



T r T 



e ps \AZ(t,s)\ z dsdt 



T r T 



o 0s 



Jt 



<aCE 



<aCE 



\Ay(s + u)\ 2 Q!(du) + \Az(t, s)\ 2 

+ [ \Az(s + u,t + u)\ 2 g 2 (du) 
Jo 

T i-T 



dsdt 



e^\Ay(s)\ 2 ds + / e? s (\Az(t, s)\ 2 + \Az(s,t)\ 2 ) 



dsdt 



o Jt 
T r T 



f e /3s \Ay(s)\ 2 ds+ f f e ps \Az(t,s) 
Jo Jo Jt 



■ dsdt 



The last inequality is due to 

i-T r T 



E 



e 0s \Az(s,t)\ 2 dsdt 



o Jt 







= E 


M 




Jo Jo 



\Az(t, s)\ 2 dsdt 



< E 









^\Ay(t)\ 2 dt 



(4.13) 



(4.14) 
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Since for all 7 e (0,1) and a, be R", \a - b\ 2 < (1 - 7 )|a| 2 - (- - l)\b\ 2 , then 



\AY(t) - AG(t)\ 2 < (1 - j)\AY(t)\ 2 -(-- l)|AG(i)| 2 . 

7 



(|4.14l) reduces to 



E 



1 



(I-7) f e f}t \AY{t)\ 2 dt + [ [ e^ s \AZ{t,s)\ 2 dsdt 
Jo Jo Jt 

T , _ r T 



<{--l)E / e pt \AG{t)\ 2 dt 
7 k/o 



T i-T 



e^\Ay{t)\ 2 dt 



e Ps \Az{t lS )\'dsdt 



Jt 



< 



\—1)k+oG 

- 7 



E 



S ^|Ay(i)| 2 d S 



T /.T 



e Ps \Az{t, s)\ 2 dsdt 



To prove T is a contraction, it suffices to show: for all K G (0, 1), there is 7 € (0, 1) such that 

( 1)k + aC < 1 - 7 and aC < 1. 

7 

which hold true via choosing a small sufficiently. 

Therefore T admits a unique fixed point (Y, Z) G (0, T) . Then (Y, Z) E .^ 2 (0,T + 5) is the unique 
adapted M-solution of VNBSFE (|4~Tj) . 

Step 3: In view of (|4.9[) in Lemma |4~2I we have 



E 



<E 



e^\Y(t)-G(t,Y t )\ 2 + J e^\Z(t,s)\ 2 ds 
^ T |*(i)| 2 + a [ T e 0s \f{t, s, Y s , Z(t, s), Z(s, t; 6))\ 2 ds 



< E^ T \M>(t)\ 2 + aC £ [\f (t, s)\ 2 + J \Y(s + u)\ 2 gi (du) + \Z{t, s)\ 2 
+ J \Z(s + u,t + u)\ 2 g 2 (du) ^jds 
Similar as the method in Step 2, we have for all a G (0, 1) and M > 0, 
E 



Pt\V(+\\*M-L. f T f T ^ 



<E 



(1-7) / e lit \Y{t)\ 2 dt+ / / eP s \Z(t,s)\ 2 dsdt 
Jo Jo Jt 

rp rj-i rjp rp 

e PT [ \f(t)\ 2 dt+{--l) [ e pt \G(t,Y t )\ 2 dt + aC [ [ e 0s \f o {t, s)\ 2 ds dt 
Jo 7 Jo Jo Jt 

T+8 r T r T 



+ aCE / e l3t \Y{t)\ 2 dt+ / / e 13 s \Z {t , s)\ 2 ds dt 
-Jo Jo Jt 

' E e 0T [ \^(t)\ 2 dt+(--l)(l + M) [ e^\G(t,0)\ 2 dt + aC [ [ e 0s \f o (t, s)\ 2 dsdt 
Jo 7 Jo Jo Jt 

(--1)(1 + — )n+aC\ I e^\Y(t)\ 2 dt + aC f f e^ s \Z(t, s)\ 2 ds dt . 
7 M J J Jo Jt . 

It is easy to prove that there are 7 G (0, 1) and M > 0, such that the following two inequalities hold for 
any k G (0, 1) via choosing a small sufficiently, 

(- - 1)(1 + tj)/« + aC < 1 -7 and aC < 1. 

7 M 



Then the estimate P~TU)) holds. 



□ 
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5 Maximum Principle 

In this section, we construct a maximum principle for the optimal control problem in section 2. 
Suppose that (X (■),&(■)) is an optimal pair. For any u(-) G U a d, denote v(-) := u(-) — «(•) and 

Ub(.) :=«(•) +£«(•) G^ad, Ve6[0,l]. 

Denote as the corresponding solution of NSFDE (|2.1[) . 

Before construct the maximum principle, we need some lemmas about the first order expansion. Let 
T be a metric space. Consider 

d\y^t)-g(t,j,y^)] =B{t,j,y t y )dt + n(t,>y,y t JdWt, t G [0, T], 
y 7 {t)=<p(t), t€[-5,0], 

where </j G C([-S, 0];R"), 

e,B:[0,T]x!lxIx C([0, <*]; R n ) -)• R n , 

K:[0,r]x!Jxrx C([0,5];R n ) ->• R" xrf . 

For any 7 G T fixed, £/(•, 7, <j>), B(-, 7, 0), 7£(-, 7, 0) are F-progressively measurable, for any G C([0, 5]; R n ), 
and satisfy the following assumptions. 

(i) <7(-,7,0) is continuous in f and 5(-,7,0) G J?f([0, T]; R"). For any fa, fa G C([0, 5];M n ), there is 
k G (0, 1), such that 

7,^1) 7,^)11 < "Hi ~ <t>2\\- 

(ii) B(-,7,0),jM(-,7,0) G J? f 2 ([0,T];R"). For any fa, fa G C([0, 5];R n ), there is L > 0, such that 

||S(t,7,<M - B(*. 7,02)11 + ||ft(t, 7, 0i) -^(t, 7,02)|| < L\\fa ~ hi 

(iii) For 7o G T, 

lim £ sup \Q(t,-f,y t lo )-G(t,y ,y t lo )\ = 0, 

T-^To t6[0 ,T] 




Lemma 5.1. Under the above assumptions, we have 



lim E sup |y 7 (t) -J/ 7o (i)| 2 = 0. 
te[o,T] 



Proof. It is easy to prove via Gronwall's inequality and the method in the proof of Theorem 14.31 □ 



Via this lemma, we can deduce the following first-order expansion. 



Lemma 5.2. Suppose that (Al) and (A2) hold. Then we have the following first order expansion, 



X e (t)=X(t)+e X (t) + R £ (t), te[0,T], 



where 

lim \e[ sup \Re{t)\ 2 } = 0. 
e^o+ e l <t<T 
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Proof. Via Lemma 15.11 it is easy to prove 



lim E sup \X £ (t) -X(t)\ 2 = 0. 
e ^ 0+ te[o,T] 



Set z e := then 



g x {t,X + 6szl)zld6 



b x (s,X + 9ezl,u E (s))z s e de + / 6„(s, X s , u(s)+0u(s)) u(s) d6» 



•/o J 

cr 2; (s,X + 6'ez',u e (s))2|rf6'+ / cr u (s, X s , u(s) + 6»u(s)) v(s) dr) dW(s). 

Jo - 1 

In view of Lemma 15.11 we have 

lim E sup \z £ {t) - X {t)\ 2 = 0. 

£~>0+ te[o,T] 



□ 



Then we have the maximum principle. 

Theorem 5.3. Suppose that (Al)-(AS) hold. Let (X(-), «(•)) be an optimal pair, and (Y,Z) G ^# 2 (0,T+ 
(5) be the adapted M -solution of linear VNBSFE (|3.3I) . XTien we have for all u G U , 



l u (t) + b' u (t)E t / Y{s)ds +a' u (t)E t / Z(s,i) ds , u - u{t) ) > 0, t G [0, T]-a.e., 



wftere Z u (f) := l(t,X\u(t)). 

Proof. In view of assumptions (Al)-(A3) and Theorem 14. 3[ VNBSFE p.3[) admits a unique pair of 
adapted M-solution (Y, Z) G ^ 2 (0,T + 5). Then, 

'• T /(t,X*,u e (t))-Z(t,^*,u(t)) 



Q< JM))-m-)) _ E 



£ 



■dt 



-E 



T pi 



X t —X t 

l u (t,Xl,u(t)+dev(t))v{t)d6 dt + E I I l u (t, X*+0(X*-X*),u(i))— 5 d6 dt 



JO 
T 



T pi 



(5.1) 



-E j \} u (t)v(t)+l x (ttf]dt + E J J [l u {t,Xlu{t)+9ev{t))-l u {t)\v{t)dBdt 



E 



i u (t,A-*+0(x|-A:*),«(t)) 



A* — X i 



t»-i x (i)x*)(ft 



'o x Jo 

In view of Lemma 15.21 we have 



£/ [iu(tMt) + i*(t)x*]<ft> o. 



Then applying assumption (A3) and Proposition ^. 2[ we have 



<E 



E 



E 



( jf L(t,r) X (t~r)X 3 (dr) + (l u (t),v(t))) 
(Y(t), p(t)) + (l u (t), v(t)))dt 



dt 



o x Jo 

T 



(l u {t),v(t))dt+ / (Y(t), / b u (s)v(s)ds) dt 



E 



Y(t), / a u (s)v(s)dW(s)) dt 



lu(t) + b' u (t) / Y(s)ds + a' u (t) / Z(s,t)ds, u(t) - u(t) ) dt. 
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The last equality is due to 



Y(t), / a u (s)Au(s)dW(s) ) dt 
1 1 \ Jo 

Z(t,s)dW{s), / a u (s)Au{s)dW(s)) dt 



\J0 
T r t 



(Z(t,s), cr u (s)Au(s)) dsdt 



So we have for all u € U and almost all t E [0, T], 



(<j' u (t) I Z(s,t)ds, Au(t)\ dt. 



l u (t)+b' u (t)E t J Y(s)ds + a' u (t)E t J Z{s,t)ds,u-u(t)\ > 0. 



□ 



Remark 5.1. If g depends on m, assume that g is continuously differentiable in u with bounded derivative, 
and g u (t) := g(t, X 1 ,u(t)) is continuously in t. Define the admissible control set as follow, 



U a d ■= {u : [0,T] X O — > U, path-continuous and bounded, F-progressively measurable}. 



Define 



p(t) := g u (t)v(t) + [ b u (s)v(s)ds+ f a u (s)v(s) dW(s). 
Jo Jo 

The maximum principle can be derived similarly. That is, for all u £ U and almost all t G [0, T], 



g' u (t)Y(t) + l u (t) + b' u (t)E t 



Y(s)ds 



Z(s, t)ds 



u-u{t) ) > 0, 



and 



g' u (0)E Y(t)dt,u(0)-u(0)j > 0. 



6 An Example 

In this section, we establish the maximum principle of a controlled stochastic differential equation (SDE) 
via the method in the preceding sections. Maximum principle for controlled SDEs was first discussed by 
Bismut [21 El S] , in which the maximum principle was established via the solution of linear Backward 
stochastic differential equations (BSDEs). Here we compare the maximum principle here with that in 
[4], and show the explicit relation between them. 

If g = and <5 = 0, the controlled NSFDE (Ti~T]) reduces to the following controlled SDE, 

J dX(t) = b(t,X(t),u(t))dt + a(t,X(t),u(t))dW(t), t e [0,T], 
[X(0)=x, 



and the cost functional reduces to 



J(u(-))=E / l(t,X(t),u{t))dt 



Suppose that (^41) and (^42) still hold. The admissible control set and the optimal control problem are 
the same as Section 2. 

As a corollary of Theorem l5.3l we have the maximum principle, 
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Corollary 6.1. Suppose that (Y, Z) G ^# 2 (0,T) is the adapted M-solution of the following equation: 



Y{t)=l x {t)+J (b' x (t)Y(s)+a' x (t)Z(s,t)^ds + j Z{t,s)dW{s). 
Let (X(-),u(-)) be the optimal pair. Then for all u G U , 



(6.1) 



l u {t) +b' u (t)E t / Y(s)ds +a' u (t)E t 



Z(s, t)ds 



, u — u 



(t) ) > 0, t e [0,T}-a.e.. 



Recall the maximum principle in Bismut [1]. 



Proposition 6.2. Suppose that (P,Q) G ^ F 2 ([0, T]; M 2 ) x Jz^O, T; R™ xd ) is the solution of the following 
BSDE: 



P(t) 



Q(s) dW(s). 



(b x {s)P(s) + a x (s)Q(s) + h x (s)^ ds - 

Let (X (•),&(•)) be the optimal pair. Then for all u G U , 

(l u (t) +b'Jt)P(t) + a' u (t)Q(t), u-u(t)) > 0, t G [0,T]-a.e.. 
In fact, the two maximum principles possess the following relationship. 
Theorem 6.3. Let (Y, Z) and (P, Q) be processes as above, then 



(6.2) 



P{t)=E t yj Y{s)ds\, Q{t)=E t yj Z(s,t)ds . 

Moreover, the maximum principle in Corollary I6.il and Proposition 1 6. i?l are equivalent. 

Proof. Similar to the proof in Theorem l5.3l we have x ^~ x ^ converges to x(-) in .3^ F 2 ([0, T]; K n ), where 
x(-) satisfies 



X (t)= / b x {s) X (s) + b u (s)v(s) 
Jo L 



ds 



o-x(s)x(s) + <t u (s)v(s) dW(s). 



Denote 



Pit) 



b u (s)v(s)ds+ / a u (s)v(s) dW(s). 



The duality between linear SDE and BSDE (|6~2|) shows 



E j (x(t), l x {t)) dt = E [ (<P(t), b u (t)v(t)) + (Q(t), fr„(tMt)>) ( 6 - 3 ) 



and the duality between linear SDE and VNBSFE (|6.ip shows 



E / ( X (t), l x (t))dt = E / (p(t), Y(t))dt 



= E 



= E 



b u (s)v(s)ds, Y(t) )dt + E 



o \J0 
T I 



a u (s)v(s)dW(s), Y(t)) dt 



\^o 

T I 



b u (t)Au(t), Y{s)ds)dt + E (a u (t)v(t), / Z{s,t)ds)dt 



Compare (|6.3p and (|6.4p . we get the conclusion. 



(6.4) 



□ 



Remark 6.1. From the foregoing discussion, the method in this paper dealing with the optimal control 
problem of NSFDEs is consistent with the traditional one dealing with SDEs. However, when the state 
equation of the optimal problem behaves more generally than semi-martingale, the traditional one is no 
longer applicable. 

Remark 6.2. For more complex case, such as the general cost function and non-convex control set, the 
optimal control problem in this paper should be discusses further. 
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